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Abstract 

We present a photometric and spectroscopic study of galaxies at 0.5 < z < 1 as a function of environment based 
on data from the zCOSMOS survey. There is a fair amount of evidence that galaxy properties depend on mass of 
groups and clusters, in the sense that quiescent galaxies prefer more massive systems. We base our analysis on a 
mass-selected environment using X-ray groups of galaxies and define the group membership using a large number 
of spectroscopic redshifts from zCOSMOS. We show that the fraction of red galaxies is higher in groups than in the 
field at all redshifts probed in our study. Interestingly, the fraction of [oil] emitters on the red sequence increases at 
higher redshifts in groups, while the fraction does not strongly evolve in the field. This is due to increased dusty star 
formation activities and/or increased activities of active galactic nuclei (AGNs) in high redshift groups. We study 
these possibilities using the 30-band photometry and X-ray data. We find that the stellar population of the red [Oil] 
emitters in groups is old and there is no clear hint of dusty star formation activities in those galaxies. The observed 
increase of red [oil] emitters in groups is likely due to increased AGN activities. However, our overall statistics is 
poor and any firm conclusions need to be drawn from a larger statistical sample of z ^ 1 groups. 

Key words: surveys, galaxies: evolution, galaxies: fundamental parameters, galaxies: clusters: general 



1. Introduction 

The matter distribution in the early universe is nearly uni- 
form, but not completely so, and small density fluctuations 
grow with time through gravitational forces. Eventually, matter 
becomes dense enough to initiate star formation and galaxies 
form in high density peaks of the density fluctuations. Galaxies 
grow progressively more massive by accreting material from 
the surroundings and by merging with other galaxies. The cos- 
mic large-scale structure, in which galaxies are embedded, also 



develops with time. Later, clusters of galaxies form at the 
nodes of filaments, where galaxies can be quenched by grav- 
itational and gas-dynamical effects. The evolution of galaxies 
and large-scale structure goes in tandem and galaxies eventu- 
ally acquire the properties that we observe today. This current 
framework of galaxy formation and evolution indicates that 
the formation and evolution of galaxies are driven by statis- 
tical events (e.g., they form in density fluctuations and grow by 
mergers) and galaxies are statistical objects in nature. They do 
not form at the same time and they do not evolve in the same 
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way. Only by statistical analyses can we study the physics of 
galaxy formation and evolution. 

This fundamental principle has motivated a number of 
galaxy surveys. Imaging surveys deliver limited information 
about galaxy properties because one needs precise distances to 
galaxies in order to translate observed quantities into physical 
quantities. For this reason, several large spectroscopic surveys 
have been carried out to date and they have brought new in- 
sights into galaxy evolution over cosmological time scales. 

The Cf A redshift survey carried out the first systematic spec- 
troscopic survey of the local universe in the late-70's (Geller 
& Huchra 1989). They measured redshifts of nearby galaxies 
and revealed the cosmic large-scale structure in the local uni- 
verse, making a major progress in our understanding of galaxy 
distribution in the universe. Following the CfA redshift sur- 
vey, the Las Campanas redshift survey (Shectman et al. 1996) 
mapped out the galaxy distribution out to larger distances, and 
the Canada-France redshift survey (Lilly et al. 1995) reached 
out to 2 = 1. The Sloan Digital Sky Survey (SDSS; York et 
al. 2000) and the 2 degree field redshift survey (2dF; CoUess 
et al. 2003) surpassed the previous surveys with much im- 
proved statistics. In particular, SDSS imaged a quarter of the 
sky in five photometric bands (Fukugita et al. 1996; Doi et al. 
2010) and measured more than 2 million redshifts with un- 
precedented precision (Aihara et al. 2011). The SDSS dramati- 
cally refined our view of the local universe. In parallel to these 
surveys of the local universe, large spectroscopic surveys with 
8m telescopes such as DEEP2 (Davis et al. 2003), VIMOS VLT 
Deep Survey (Le Fevre et al. 2005), and zCOSMOS (Lilly et al. 
2007) peered deep into the universe reaching z>l. All of these 
surveys enabled statistical analyses of galaxy populations over 
a large redshift range, bringing in new insights into the evolu- 
tion of galaxies. This paper is in a context of such statistical 
galaxy studies from large spectroscopic surveys. We will study 
galaxy properties out to z = 1 using data from zCOSMOS with 
a particular emphasis on the dependence of galaxy properties 
on environment. 

A pioneering work on this subject was made by Dressier 
(1980), who first quantified the morphology-density relation. 
Following this work, many authors studied the relationship 
between galaxy properties and environment (e.g.. Postman & 
Geller 1984; Whitmore et al. 1993; Balogh et al. 1997; Dressier 
et al. 1997; Poggianti et al. 1999; see Tanaka et al. 2005 for 
a thorough set of references and also see below for more re- 
cent papers). The SDSS and 2dF data sets delivered the un- 
precedented statistics and we now have a fairly good under- 
standing of galaxy properties in the local universe (Lewis et 
al. 2002; Gomez et al. 2003; Blanton et al. 2003; Goto et al. 
2003; Kauffmann et al. 2004; Tanaka et al. 2004; Blanton et al. 
2005; Baldry et al. 2006). The advent of 8m-class telescopes 
pushed those environment studies to redshift of unity and be- 
yond ( Rosati et al. 1999; Kodama et al. 2001; Lubin et al. 
2002; Demarco et al. 2005; Nakata et al. 2005; Poggianti et al. 
2006; Stanford et al. 2005; Tanaka et al. 2005; Stanford et al. 
2006; Demarco et al. 2007; Koyama et al. 2007; Fassbender 
et al. 2008; Lidman et al. 2008; Poggianti et al. 2008; Mei et 
al. 2009; Bauer et al. 2011; Rettura et al. 2010; StrazzuUo et 
al. 2010; Tanaka et al. 2010a; Tanaka et al. 2010b). However, 
many of these high-z studies still suffer from limited statistics 



particularly in low-medium density environments and this is 
the area where large spectroscopic surveys fill in as they mainly 
probe such environments (Cucciati et al. 2006; Cooper et al. 
2007; Tasca et al. 2009; Bolzonella et al. 2010; Cucciati et al. 
2010; Cooper et al. 2010; lovino et al. 2010). 

However, results from these deep surveys and their interpre- 
tations are not always consistent. In particular, the dependence 
of galaxy colors on environment at 2 ^ 1 is controversial as 
discussed in Cooper et al. (2010). There are a number of differ- 
ences between the data sets from different surveys and the ways 
the analyses are made, which might explain the possible incon- 
sistency. In this paper, we study photometric and spectroscopic 
properties of galaxies as a function of environment and make 
an attempt to settle the issue. A unique feature of our study is 
that we define mass-selected environments using X-ray groups. 
Most of the previous studies are based on environment traced 
by galaxies and there is room for observational biases to come 
in. Such biases include sampling rate, redshift success rate as 
functions of redshift and galaxy type, large-scale structure, etc. 
For example, if a sample is biased towards star forming galax- 
ies, which can be the case at high redshifts in optical surveys, 
the density field traced by galaxies is basically the density of 
star forming galaxies, which may not represent the true density 
field. X-rays, on the other hand, are free from such biases. An 
extended X-ray emission is a strong signature of a dynamically 
bound system. Also, an X-ray luminosity is a good proxy for 
mass of a system, making it possible to define environments by 
mass. We present a robust analysis of the dependence of galaxy 
properties on environment based on stellar mass limited galaxy 
sample with mass-selected environments. 

The structure of this paper is as follows. We briefly summa- 
rize the zCOSMOS survey and construct an X-ray group cata- 
log in Section 2. We then study properties of the group galaxies 
and make comparisons to field galaxies in Section 3. Section 
4 discusses the results and the paper is concluded in Section 5. 
Unless otherwise stated, we use = 0.26, J^a = 0-74, and 
Hq = 72 km Mpc^^. The uncertainties are given in 68% 
confidence intervals. All the magnitudes are given in the AB 
system. 

2. X-ray Group and Member Galaxy Catalogs 

We study spectroscopic properties of galaxies up to z = 1 
based on data from the zCOSMOS survey (Lilly et al. 2007). 
We first briefly describe the survey and move on to construct a 
catalog of galaxy groups selected from deep X-ray data. 

2.1. The zCOSMOS redshift survey 

The zCOSMOS survey is a spectroscopic survey of the 
COSMOS field (Scoville et al. 2007; Koekemoer et al. 2007) 
using the VIMOS spectrograph on the Very Large Telescope on 
the Cerro Paranal (Le Fevre et al. 2003). It is the largest pro- 
gram ever conducted at VLT with 600 hours of allocated time. 
The survey consists of two components: zCOSMOS-bright and 
zCOSMOS-faint. The former is a flux-limited survey down 
to Iab =22.5 using the medium resolution grism (R ^ 500) 
with a wavelength coverage of 5550 - 9650A. The latter IS a 
color-selected galaxy survey aiming at z ^2 galaxies using the 
low -re solution blue grism with R ~ 200 over 3700 — 6700A. 
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All the spectra are visually inspected by two people indepen- 
dently and final redshifts and confidence flags are determined 
through face-face reconciliation meetings. In this study, we use 
the zCOSMOS-bright 20k data to perform statistical analysis 
of galaxy groups. For further derails of the survey, the readers 
are referred to Lilly et al. (2007) and Lilly et al. (2009). 

2.2. X-ray group catalog 

We construct an X-ray group catalog using X-ray data from 
XMM-Newton and Chandra available in the COSMOS field 
(Hasinger et al. 2007; Elvis et al. 2009). An early version of 
the group catalog was presented in Finoguenov et al. (2007), in 
which we relied only on photometric redshifts to identify the 
optical counterparts of extended X-ray emission. We revise the 
catalog with an efficient group identification algorithm demon- 
strated by Bielby et al. (2010) and Finoguenov et al. (2010) 
to the massive COSMOS data set. We give the full details in 
Finoguenov et al. (in prep), and here we only briefly outline 
our algorithm. 

On the mosaic of coadded XMM and Chandra images, clus- 
ter candidates are first identified as extended sources through 
a classical wavelet transform technique with a careful removal 
of point sources (Finoguenov et al. 2009). Next, we look for 
the cluster red sequence around the extended X-ray sources us- 
ing the deep optical-lR data. For this red sequence search, we 
construct model red sequence using the recipe by Lidman et 
al. (2008) and quantify a significance of red sequence around 
an extended X-ray source at a given redshift in the following 
manner: 

• We extract galaxies located within 1 Mpc (physical) 
from the X-ray center and have l^p/iot — z| < 0.1, where 
Zphot is the photometric redshift of a galaxy and z is the 
redshift at which we want to quantify the red sequence. 

• We count galaxies with weights according to their spatial 
locations from the X-ray center and to their location on 
a color-magnitude diagram. Bright red galaxies located 
at the center have the highest weight. 

• We compare the count with the average count and its dis- 
persion, which are derived by placing the apertures of the 
same size at random positions in the COSMOS field, to 
quantify the significance of the red sequence. 

• We repeat the above procedure at < z < 2.5 to identify 
peaks of the red sequence signals. 

• Finally, we visually inspect all the significant peaks and 
assign redshift and confidence flag to the X-ray source. 

In the first procedure, we make use of the excellent pho- 
tometric redshift in the COSMOS field (Ilbert et al. 2009) to 
efficiently eliminate fore-/background contamination. In the 
second step, we change the filter combinations to compute col- 
ors with redshift. We have to make a compromise between the 
depth of the data and filter combinations to probe similar rest- 
frame wavelengths at different redshifts, but we always straddle 
the 4000A break, which is a sensitive feature to star formation. 
To be specific, we use the following color-magnitude diagrams. 

• 0.0 < z < 0.3 : u — r vs. r 

• 0.3<z<0.6: B~ivs. i 

• 0.6 < z < 1.0 ; r — z vs. z 



• 1.0 < z < 1.5 : i - Ks vs. Ks 

• 1.5 < z < 2.5 : z — 3.6/iTO vs. 3.6^m 

Finally, all the significant red sequence signals are visually 
inspected and the group redshifts and confidence flags are as- 
signed. We use the 20k redshifts from zCOSMOS (Lilly et 
al. 2007) to help identify the systems and obtain spectroscopic 
redshifts of them in this final identification procedure. Details 
of the confidence flags will be described in Finoguenov et al. 
(in prep.), but in short, we give Flag=1 to groups that are 
unambiguously confirmed with spectroscopic redshifts and the 
X-ray centroid is reliably determined by high significance X- 
ray fluxes. Flag=2 is for spectroscopically confirmed groups 
whose X-ray center can potentially be off (up to 30 arcsec) due 
to low fluxes or to blending with other sources, and the location 
of the optical counterparts were used in the centroid determi- 
nations. We have confirmed that these uncertain centroids do 
not affect our results as we discuss below. Flag=3 groups are 
likely real groups but they are not spectroscopically confirmed 
yet. The catalog contains 215 groups with Flag=1, 2 or 3, of 
which 195 are at z < 1. We note that - 90% (175 out of 195) 
of the groups at z < I are spectroscopically confirmed (i.e., 
Flag=1 or 2). We do not use those Flag=3 groups in this 
work, but we have confirmed that our results do not change if 
we include them. 

2.3. Group members from zCOSMOS 

We define the group membership using the X-ray group cat- 
alog constructed above and the spectroscopic redshifts from 
zCOSMOS. In this work, we apply the following selection cri- 
teria to study the dependence of galaxy properties on environ- 
ment: 

1. We use spectroscopically confirmed groups at 0.5 < z < 
1.0 with masses between 3 x lO^^M© and 7 x lO^^M©. 

2. We define group members as galaxies with high confi- 
dence spectroscopic redshifts from zCOSMOS and lo- 
cated within < 2(7 and < i?2oo from the group centers, 
where cr is line-of-sight velocity dispersion and i?2oo is 
a virial radius of a group within which the mean interior 
density is 200 times the critical density of the universe at 
the group redshift. 

The first criterion is about groups themselves. We want to 
reduce spurious groups that contaminate the analysis. For this, 
we use groups with flag 1 or 2. As mentioned above, they 
are spectroscopically confirmed groups. We then restrict the 
sample to 0.5 < z < 1.0 as shown in Fig. 1. This redshift 
selection is motivated to have the [Oil] emission in our spectral 
coverage. The line is not available at z < 0.5 and we could in 
principle use Ha to fill that redshift range. But, these two lines 
have different sensitivities to star formation and AGN (e.g.. Ha 
is much more robust to extinction) and it is hard to make fair 
comparisons between [oil] emitters and Ha emitters. We do 
not include the z < 0.5 groups in order to perform a robust 
analysis. We do not include z > 1 groups either as extremely 
strong fringes in the VIMOS spectra decrease the success rate 
of obtaining redshifts of passive galaxies at z > 1, making any 
spectral analysis at z > 1 difficult. 

In addition to the redshift criterion, we impose a group mass 
threshold. As shown by previous studies (e.g., Tanaka et al. 
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2005; Poggianti et al. 2006; Koyama et al. 2007), galaxy prop- 
erties depend on group mass. In order to eliminate any strong 
group mass dependence and extract evolutionary trends, we 
use groups with masses (il/200, which is the mass contained 
within i?20o) between 3 x IO^^Mq and 7 x IO^^Mq as shown 
in Figure 1. Note that M200 is derived from the X-ray scal- 
ing relation calibrated against weak lensing mass estimates 
(Leauthaud et al. 2010). We still have a weak mass tendency 
within the narrow mass range in the sense that we tend to have 
more massive systems at higher redshifts. This bias weakens 
any evolutionary trends because more massive groups tend to 
be more evolved. If we had a flat group mass distribution at 
0.5 < z < 1.0, we would have observed stronger evolutionary 
trends than those shown below. 

The second criterion is the definition of group members. In 
this work, we use galaxies with highly confident spectroscopic 
redshifts from zCOSMOS. Specifically, we use galaxies with 
flags 4's, 3's (including 14's and 13's), 2.5, 2.4, 9.5, 9.4, and 
9.3. For details of the flags, readers are referred to Lilly et al. 
(2009). 

To define the group membership, we first estimate A/200 
from the X-rays. From this, we evaluate the velocity disper- 
sions (a) and virial radii (i?20o) of the groups assuming that 
they are virialized (Carlberg et al. 1997). As most group galax- 
ies are observed to lie within ^ i?200 in the local universe 
(Gomez et al. 2003; Tanaka et al. 2004), we define group mem- 
bers as those within < i?2oo from the centers. The centers of 
groups with Flag=2 can be uncertain, but this is not a major 
concern in our analysis because a typical i?200 of these groups 
is 2.5 times larger than the maximum positional uncertainty of 
30 arcsec. We have checked the robustness of our results by 
perturbing the centers of the Flag=2 groups with a Gaussian 
function with a ^ 30 arcsec and repeated all the analysis in 
this paper We have observed no appreciable changes in our 
results. For the line-of-sight separation, we apply < 2a from 
the redshift centers of the groups. Galaxies that do not belong 
to any groups are defined as field galaxies. In total, we have 
7,549 galaxies with high confidence redshifts at 0.5 < z < 1, of 
which 246 are in groups satisfying the criteria above. We will 
further apply a stellar mass cut to the galaxies in the next sec- 
tion, and the total numbers of galaxies used in the main anal- 
yses are 1,574 and 96 for the field and group environments, 
respectively. 

3. Galaxy Populations in the X-ray Groups at 0.5 < z < 
1.0 

3.1. Color-mass diagram and the fraction of red galaxies 

We base our analysis on the group catalog and member cat- 
alog constructed in the last section and study properties of 
galaxies as functions of redshift and environment (i.e., group 
vs. field). To give an overview of the properties of galaxies in 
our catalog, we show a rest-frame u~r color vs. stellar mass 
diagram in Fig. 2. The rest-frame color and stellar mass are de- 
rived by Bolzonella et al. (2010) by fitting the photometry with 
model templates from Bruzual & Chariot (2003) assuming the 
Chabrier initial mass function (Chabrier 2003). A typical error 
in our stellar mass estimates is ^ 0.2 dex (see Bolzonella et al. 
2010 for details). Before we discuss the plot, let us introduce 
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Fig. 1. M200 of groups measured from X-rays plotted against redshift. 
We use groups with high confidence flags only. We make three redshift 
bins (0.5 < z < 0.67, 0.67 < z < 0.84, and 0.84 < 2 < 1.00) as 
indicated by the vertical dashed lines, where we have the [Oil] line in 
the spectral wavelength coverage and we are not strongly affected by 
fringes in the spectra. In order to minimize the group mass dependence 
of galaxy properties, we use a nan'ow mass range as shown by the shade 
in this work. The sizes of the symbols correlate with the number of 
spectroscopic members. 

our definition of (a) red/blue galaxies and (b) [Oil] emitters. 

(a) We divide galaxies into red and blue galaxies by their 
rest-frame u — r color. We perform a biweight fit to the red se- 
quence in groups at 0.67 < z < 0.85, where we observe the most 
prominent red sequence due to the largest number of group 
galaxies we have there. We then shift it by A(u — r) = —0.3 
shown as the slanted dashed line in Fig. 2 to separate the two 
populations. The amount of the shift is motivated to give a rea- 
sonable separation between [oil] emitters and non-[oil] emit- 
ters (see below for their definitions). We have confirmed that 
our conclusions are insensitive to a small change in the amount 
of the shift. We correct for the color evolution of the red se- 
quence in the other bins using an instantaneous burst model 
formed at zj =3 from Bruzual & Chariot (2003). As seen in 
the figure, the color threshold is bluer at higher redshift. 

(b) We also use [oil] emission to characterize galaxy prop- 
erties. We use the equivalent widths of [oil] measured by 
Lamareille et al. (in prep). Line detections below 1.15ct are 
considered fake and here we adopt a conservative significance 
threshold of 2.3cr to ensure that the line is securely detected. 
We define galaxies with EW[OII]< -5A detected at > 2.3cr 
as [on] emitters, and the other galaxies as quiescent. Note we 
use a negative sign for emission. 

Going back to Fig. 2, it is immediately clear that the most 
massive galaxies tend to be red and many of them do not show a 
sign of active star formation. Galaxies with no significant [oil] 
form a clear sequence of red galaxies. Interestingly, some of 
the red galaxies show significant [oil] emissions despite their 
red colors. In contrast to massive galaxies, low-mass galaxies 
are predominantly blue [oil] emitters. This is due to a bias 
introduced by the flux limit of the survey. The /-band, with 



No. 



Tanaka et al. 



10^ ^qIO ^qU ^q9 ^qIO ^q11 ^q9 ^qIO ^q11 



5- 

I 




M 



stellar 



[Mo] 



Fig. 2. Rest-frame u — r color plotted against stellar mass. The top panels show the group galaxies and the bottom panels show the field galaxies. 
The panels are split in three redshift bins. The filled and open symbols show galaxies with and without significant [Oil] emission (EW[OII]< -5A at 
> 2.3(t), respectively. The vertical dashed lines are our mass threshold, which defines the stellar mass hmited galaxy sample. We separate red and blue 
galaxies using the slanted dashed line. For clarify, we plot only one third of the field galaxies. 



which spectroscopic targets are selected in zCOSMOS, sam- 
ples bluer light in rest-frame at higher redshifts, and we are 
missing low-mass red galaxies, resulting in a strong bias to- 
wards blue, star forming galaxies. 

It is hard to interpret Fig. 2 due to the strong selection 
bias. We apply a stellar mass cut in each redshift bin to con- 
struct a stellar mass limited sample in order to study evolu- 
tionary trends. We have to correct for the mass evolution in 
each redshift bin, but we cannot track the mass evolution of 
individual galaxies, which depends on their star formation and 
merger histories. Here, we simply apply correction for the pas- 
sive evolution using the same passive evolution model as used 
for the color evolution. We can reach ^ 5 x lO^^M© galax- 
ies at z = 1 in zCOSMOS, although the redshift success rate 
drops to 70% (see Figs 2 and 10 of Lilly et al. 2009). Cucciati 
et al. (2010) and lovino et al. (2010) applied a conservative 
cut of 10^ ^M0, but for the purpose of the paper, we do not 
need to be 100% complete and we apply a stellar mass thresh- 
olds of 4.95 X IQIOMq, 5 x 10^°Mq, and 5.05 x IQIOMq at 
0.5 < z < 0.67, 0.67 <z< 0.84, and 0.84 < z < 1, respectively. 
We note that our conclusions do not change if we adopt a con- 
servative mass cut of IO^^Mq, although the statistics becomes 
poor. Balogh et al. (20 11) reported on an abundant population 
of green valley galaxies in groups at 0.85 < z < 1. We do 
not observe strong evidence for an increased amount of green 
galaxies in Fig. 2, but we cannot probe as low-mass galaxies 
as they did (IOIO-^Mq). 

We plot the fraction of red galaxies as a function of redshift 
in Fig. 3 using the stellar mass limited sample. The fraction of 
massive red galaxies remains constant over the explored red- 
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Fig. 3. Left: Fraction of red galaxies plotted against redshift. Here 
we use the stellar mass limited sample in both the group and field en- 
vironments. The filled and open symbols are for the group and field 
samples, respectively. They are slightly shifted horizontally to avoid 
overlapping. The error bars show 68% confidence interval (Gehrels 
1985). Riglit: Fraction of [Oil] emitters among red galaxies against 
redshift. 
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shift range in both groups and field. An interesting trend in 
Fig. 3 is that the red fraction is always higher in groups than 
in the field, showing clear environmental dependence of galaxy 
colors at 0.5 < z < 1. This may appear inconsistent with previ- 
ous studies (e.g., Cucciati et al. 2010; lovino et al. 2010), and 
we will discuss that in Section 4. 1 . While we do not see strong 
color evolution, we see a clear increase in the fraction of [oil] 
emitters among red galaxies at high redshifts as shown in the 
right panel of Fig. 3. As discussed earlier, our group sample is 
biased towards more massive groups at higher redshifts, which 
weakens any evolutionary trends. Also, due to the nature of a 
mass limited sample, spectra at higher redshifts are of lower 
signal-to-noise ratios. We tend to miss weak [Oil] emissions 
at higher redshifts, which weakens the trend we see here'. The 
real evolutionary trend should be stronger than that observed in 
Fig. 3. 

The fraction of red [oil] emitters in the field remains nearly 
constant with redshift, while it evolves very fast in groups. The 
fractions become indistinguishable in between groups and field 
in the highest redshift bin. These red [Oil] emitters must have 
dusty star formation activities and/or AGN activities. This is 
a sort of evolution that cannot be revealed by broad-band pho- 
tometry, demonstrating a power of large spectroscopic surveys. 

3.2. Stellar mass and redshift dependence of the [Oil] emit- 
ters 

Essentially all galaxy properties are correlated with stellar 
mass. It would be important to show that the higher red frac- 
tion in groups observed in Fig. 3 is not due to the environmen- 
tal dependence of the stellar mass function such that groups 
host a larger fraction of massive galaxies, which increases the 
red fraction because massive galaxies tend to be red. We plot in 
Fig. 4 the fraction of red galaxies as functions of stellar mass 
and redshift. We find that the red fraction tends to be higher 
in groups than in the field at a given stellar mass, although the 
error bars often overlap. The difference between groups and 
field is particularly clear at 0.67 < z < 0.84, where we have a 
prominent large-scale structure (Guzzo et al. 2007). The poor 
statistics does not allow us to conclude that the groups show a 
higher red fraction at a given stellar mass, but the systemati- 
cally higher fraction suggests that the observed high red frac- 
tion in groups in Fig. 3 is not entirely due to the dependence of 
stellar mass function on environment. We note that George et 
al. (2011) showed that the red fraction is higher in groups than 
in the field at a given stellar mass based on the same X-ray 
group catalog and on the photometric data in COSMOS. 

Similarly, it would be interesting to look at the stellar mass 
dependence of the [oil] emitters on the red sequence. We plot 
in Fig 5 the fraction of the red [oil] as a function of stellar 
mass. In the field, the fraction of the red [oil] emitters does 
not strongly depend on mass above the mass threshold. The 

' One might suspect that we tend to miss quiescent red galaxies at 2 ~ 1 
due to the busy OH lines, and that might be driving the observed increase 
of red galaxies with [on] emission, which are easier to identify. However, 
as will be discussed in Section 3.2, red [Oil] emitters increases with in- 
creasing stellar mass in the highest redshift bin. This is an opposite trend 
from what expected from the redshift determination bias because we do 
not miss massive (bright) passive galaxies even under the presence of busy 
OH lines. Therefore, the observed trend is unlikely due to an observational 
bias. 



overall fraction does not show a strong increase with redshift 
either On the other hand, the fraction in groups increases at 
higher redshift, and in the highest redshift bin, the fraction of 
[oil] emitters seems to increase with increasing mass above the 
mass cut. Although the statistics is poor, this is a contrasting 
trend to the field. It seems that the increase of [oil] emitters in 
groups at high redshift is stronger for more massive galaxies. 

A high fraction of [oil] emitters at z ~ 1 has akeady been 
observed by several authors. Nakata et al. (2005) found a frac- 
tion of EW[on]< -lOA galaxies of ~ 0.45 ±0.15 at 0.8 < 
z <\. Their sample is not stellar mass limited and we cannot 
make a fair comparison with theirs. But, if we apply the same 
selection of EW[oil]< — lOA to our sample, we obtain a con- 
sistent fraction of 0.31 ± 0.07. Poggianti et al. (2006) showed 
the high fraction (very roughly 50%) in groups and clusters at 
0.4 < z < 0.8. If we apply EW[oil] < -SA as done in Poggianti 
et al. (2006), we obtain a consistent fraction. A similarly high 
fraction of [oil] emitters in groups at higher redshift (z = 1.2) 
is reported by Tanaka et al. (2009). If we apply our definition 
of [on] emitters and the stellar mass cut to their sample, we 
find that the fraction of massive [Oil] emitters is 0.47 ± 0.22. 
We should be careful with this face value as their sample was 
drawn from optically selected groups and the targets for spec- 
troscopy were photo-z selected, which potentially introduces 
biases in the sample. However, this high fraction of [oil] emit- 
ting galaxies in groups drawn from completely different sample 
is reassuring. Unfortunately, their sample is not large enough 
to constrain the mass dependence of the [oil] emitters. 

Not only the fraction of red [oil] emitters, but strengths of 
the emission seem to increase with increasing redshift as shown 
in Fig. 6. Field galaxies do not show any strong change in 
the median EW[oil] with redshift. On the other hand, group 
galaxies seem to show a larger EW[Oll] tail at higher redshifts. 
The distributions of EW[oil] in groups at 0.67 < z < 0.84 
and 0.84 < z < 1 show a null probability of 3% from the 
Mann- Whitney U test. This increase in EW[oil] would not 
be too surprising given the rapid increase in the fraction of 
[on] emitters observed in Fig. 3, which is statistically signif- 
icant. We have only one red [oil] emitter at 0.50 < z < 0.64, 
and we cannot apply any statistical tests there. In contrast 
to groups, field galaxies do not show any strong evolutionary 
trends: the Mann- Whitney test gives a null probability of 33% 
between 0.50 < z < 0.64 and 0.67 < z < 0.84, and 47% be- 
tween 0.67 < z < 0.84 and 0.84 < z < 1. Wilman et al. (2008) 
showed that ^ 50% of galaxies with lO'^'^M© in z ~ 0.4 groups 
show infrared flux excess, which can be due to star formation 
and/or AGN. The observed low frequency of the [Oil] emitters 
compared to the infrared detections may be because [oil] and 
infrared have different sensitivities to star formation and AGN. 
It could also be because of our conservative EW[oil] cut. 

To summarize, we observe that the fraction of red galaxies 
with > 5 X lO'^^M© does not strongly evolve at 0.5 < z < 1 
in both group and field environments, and it is always higher 
in groups than in the field. The most striking trend that we 
find is that the fraction of red [oil] emitters in groups increases 
at higher redshifts, while the fraction is nearly constant in the 
field. It seems that more massive galaxies in groups show 
stronger increase in [Oil]. This trend suggests that the red 
galaxies in groups have dusty star formation and/or AGN ac- 
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Fig. 4. Fraction of red galaxies as a function of stellar mass in the three redshift bins. The filled and open circles are the group and field galaxies, 
respectively. The vertical dashed lines are the mass thresholds, which define the stellar mass limited sample. The error bards are the 68% confidence 
intervals. 
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Fig. S. Fraction of red [Oil] emitters as a function of stellar mass. As in Fig. 4, the panels are split into the three redshift bins. The vertical dashed lines 
are the stellar mass cuts. The eiTor bars are the 68% confidence intervals. 
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Fig. 6. Distribution of EW[OII] of red galaxies measured at > 2.3<t in 
groups (shaded histogram) and in the field (open histogram) environ- 
ments based on the stellar mass limited sample. The arrows point the 
median of the EW[OII] in each environment. 

tivities and the rates at which environment suppresses such ac- 
tivities are different in different environments. We will pursue 
this point in the next section. 



4. Discussions 

4.1. Comparisons with previous studies 

Recent large spectroscopic surveys such as zCOSMOS 
(Lilly et al. 2007), DEEP2 (Davis et al. 2003), and VVDS (Le 
Fevre et al. 2005) have enabled statistical analysis of galax- 
ies in the universe up to z = 1 and even beyond. Several 
authors have studied the environmental dependence of galaxy 
properties using data from those surveys (e.g., Cucciati et al. 
2006; Cooper et al. 2007; Gerke et al. 2007; Cooper et al. 
2010; Cucciati et al. 2010; lovino et al. 2010). But, the re- 
sults from those papers are not always consistent. In particular, 
results on the color-density relation at z 1 and interpretations 
of it seem to be controversial. 

In fact, our finding that the fraction of red galaxies depends 
on environment up to z ^ 1 does not seem to be consistent at 
a first glance with those from Cucciati et al. (2010) and lovino 
et al. (2010) who have found no strong dependence of galaxy 
colors on density at z ~ 1 based on a stellar mass limited sam- 
ple. Another finding by lovino et al. (2010) that the red frac- 
tion decreases with increasing redshift is not consistent either 
Cooper et al. (2010) discussed differences in the data sets and 
in the ways analyses were made in the literature. But, we use 
basically the same data set as Cucciati et al. (2010) and lovino 
et al. (2010) and the observed differences appear at odds. Here 
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we attribute the cause of the differences to differences in (i) 
definitions of environments and in (ii) definitions of red galax- 
ies. 

There is a fair amount of evidence that galaxy properties de- 
pend on the mass of groups and clusters at high redshifts (e.g., 
Tanaka et al. 2005; Poggianti et al. 2006; Koyama et al. 2007). 
In this paper, we use X-ray selected groups, while most of the 
previous papers from large spectroscopic surveys are based on 
galaxy groups (or galaxy densities) identified using spectro- 
scopically observed galaxies. There are pros and cons in these 
environment definitions, but the advantage of the X-ray groups 
is that our environment is mass-selected. As mentioned earlier, 
90% of the groups at z < 1 in COSMOS are spectroscopically 
confirmed, and we probably sample the group-mass environ- 
ments well in this study. A further comparison between optical 
and X-ray groups will be made in Finoguenov et al. (in prep). 

A disadvantage would be that we cannot identify very low- 
mass groups which are below our X-ray detection limit, while 
optical group identification algorithms can. We suspect that 
these low-mass groups would be the primary cause of the dif- 
ference from Cucciati et al. (2010) and lovino et al. (2010). 
lovino et al. (2010) showed that optically poor groups tend to 
exhibit a lower red fraction than optically rich groups. Poor 
groups are more numerous than rich ones and they dominate 
the group sample, which results in a smaller difference in the 
red fraction between groups and field. The difference in the 
group mass ranges explored could account for the difference in 
the dependence of the red fraction on environment between us 
and the previous studies. We note that George et al. (201 1) re- 
cently observed clear dependence of the red fraction as a func- 
tion of stellar mass on environment based on the photometric 
data in COSMOS. 

Another cause of the difference is that our definition of red 
galaxies is different from that adopted in lovino et al. (2010). 
They adopted a color threshold of U — B = 1 regardless of 
redshift and stellar mass of galaxies, while we account for the 
tilt of the red sequence with respect to stellar mass and also for 
the passive evolution. We have confirmed that the red fraction 
decreases at higher redshifts if we adopt the same definition as 
theirs. We prefer to account for the tilt and passive evolution to 
define red/ blue galaxies in this paper. The above two reasons 
are likely the primary causes of the somewhat different results 
between us and the previous authors. 

Gerke et al. (2007) and Cooper et al. (2007) also suggested 
that the red fraction decreases with increasing redshifts in high 
density environments. This might be due to the selection of 
galaxies. They applied a rest-frame B-band magnitude cut, not 
a stellar mass cut. The B-band magnitude cut introduces a 
strong bias towards star forming galaxies, which could result 
in a lower red fraction at higher redshifts. 

We note that there is a non-zero possibility that we are miss- 
ing groups dominated by blue galaxies because we used the 
red sequence finder in the group identification process and 
that could possibly enhance the difference between groups and 
field. However, our technique uses a contrast of the red se- 
quence between group and field and we do not actually require 
a higher fraction of red galaxies in groups. Even if groups had 
the same red fraction as the field, we can identify them as long 
as they show an over-density. We miss only groups in which 
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Fig. 7. Fraction of quiescent galaxies with [NUV — r)^^^^^ > 3.5 
among the red galaxies in groups and field with/without [Oil] plotted 
against redshift. The meanings of the symbols are shown in the plot. 
The error bars show the 68% confidence intervals. 

the fraction of red galaxies is significantly lower than the field. 
It is unlikely that such very blue groups are so abundant that 
they change our results significantly because we have identi- 
fied ~ 90% of all the X-ray group candidates at z < 1 with high 
significance and they exhibit a clearer red sequence compared 
to field galaxies. 

Recently, Koyama et al. (201 1) reported on Ha narrow-band 
imaging of a z = 0.4 cluster. They found that groups exhibit 
a higher fraction of Ha emitters than in the field, which is in 
contrast to our finding in the right panel of Fig. 3. There are 
a number of differences in the explored stellar mass range, ob- 
serving technique, emission line used and emission line sensi- 
tivity. These differences hinder detailed comparisons with our 
results. 

4.2. Origin of the [Oil] emission - star formation vs AGN 

The increasing fraction of red [Oil] emitters with increasing 
redshift must be due to increasing dusty star formation activi- 
ties and/or AGN activities. Recent studies of z > 1 clusters also 
reported on increased rate of emission line galaxies in clusters 
than in lower redshift clusters (e.g., Hayashi et al. 2010, but 
see also Bauer et al. 2011). But, this trend is not established 
yet, and it is not clear if the emission line originates from star 
formation or AGN activities either. 

Let us first ask if the [oil] emission is due to dusty star for- 
mation. We look at the {NUV — r)dered color of the [Oil] 
emitters taken from Ilbert et al. (2009). The {NUV - r)dered 
color is a reddening corrected color of galaxy templates used 
for the photometric redshift estimates (i.e., the raw template 
colors without dust extinction) using the 30-band photometry. 
This is sensitive to on-going star formation as shown by Ilbert 
et al. (2010). We adopt a threshold of {NUV - r)<jered = 3.5 to 
separate quiescent galaxies from star-forming galaxies (Ilbert 
et al. 2010) and plot the fraction of quiescent galaxies in Fig. 
7. As the color from Ilbert et al. (2009) is based on photomet- 
ric redshifts, we use galaxies with correct photometric redshifts 
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< 0.05). We note that this analysis is essentially 



equivalent to the popular two-color diagnostics to separate qui- 
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escent red galaxies from dusty ones (Wolf et al. 2005; Wolf et 
al. 2009). But, instead of using only 2 colors, we here make use 
of the 30-band photometry that gives a fine sampling of galaxy 
SEDs over a wide wavelength range to discriminate quiescent 
galaxies from dusty star forming ones. 

Let us start with the red galaxies without significant [oil] 
emission shown by the open and filled triangles. The quies- 
cent fractions of these galaxies are very high as expected from 
the absence of [Oil]. The stellar population of these galaxies 
is typically old and there is no significant difference between 
groups and field. That is, if red galaxies exhibit no [oil], they 
are dominated by old stellar populations regardless of environ- 
ment. Now, we turn our attention to the red [Oil] emitters. The 
quiescent fraction of the red [oil] emitters in the field (open 
circle) is relatively low (30 — 40%), suggesting that more than 
a half of them are not quiescent and are probably undergo- 
ing dusty star formation. In contrast, the red [oil] emitters in 
groups (filled circle) show a very high quiescent fraction even 
at high redshifts and it is as high as those without [oil] emis- 
sion. This suggests that red [oil] emitters in groups are domi- 
nated by old stellar populations despite the [Oil] emission. In 
Fig. 3, we observed a sharp increase in the fraction of red [Oil] 
emitters in high redshift groups, but the quiescent fraction does 
not show a corresponding decrease. There is no clear evidence 
for increased dusty galaxies in the red [oil] emitters in groups. 
Instead, Fig. 7 favors the AGN origin. 

Let us then stand on the other side of the view and ask 
whether the [oil] emission comes from AGNs. At the redshift 
range under study, we cannot use strong emission line diagnos- 
tics such as the one proposed by Baldwin et al. (1981) to iden- 
tify AGNs as the Ha line migrates to near-IR. Here we take an- 
other way to identify AGNs - X-rays - and quantify how AGNs 
populate in the redshift range studied here. We use the Chandra 
point source catalog (Elvis et al. 2009) and apply an X-ray lu- 
minosity cut of Lo.5-iokeV > 10^^ cig s^^, at which we are 
nearly complete up to z = 1. In the field, an X-ray detection 
rate of the red [oil] emitters seems to increase in the highest 
redshift bin: 0.04±0.03, 0.03±0.02, and 0.13±0.04fromlow 
to high redshift bins. However, we detect no red [Oil] emitters 
in groups in X-rays: O.OOiJ^ J^^, O.OOio i^o, and OmtoH ^om 
low to high redshifts. 

Most of the red [oil] emitters in groups are not detected 
in X-rays (only 2 are detected, but with luminosities be- 
low the cut applied above). Tanaka et al. (2011) found that 
AGNs in quiescent galaxies are typically soft, low-luminosity 
AGNs in the local universe. Motivated by this, we performed 
a stacking analysis of those undetected sources in the soft 
band with a special care to remove the extended component 
(Finoguenov et al. 2009). By stacking 9 objects that are not 
individually detected, we measure an average luminosity of 
2.8 X 10~^^ erg s^^ cm^^ in 0.5-2 keV, which translates into 
2.7 X ID'''' and 1.5 x 10^^ erg s"^ at z = 0.5 and z = 1, re- 
spectively. This luminosity level can be explained both by 
low-luminosity AGN and star formation origins. We cannot 
constrain the AGN fraction in groups with X-rays. 

X-rays unfortunately do not put any constraint on the AGN 
or dusty star formation origin, but the robust photometric anal- 
ysis based on the 30 photometric bands presented above seems 
to lend support to the AGN origin of the [Oil] emission, al- 



though the statistics is poor. The stellar population of the red 
[on] emitters in groups is old and there is no hint of strong 
on-going star formation in those galaxies. The observed [oil] 
emission is unlikely due to star formation and the most proba- 
ble origin of it is AGNs. 

A possibility of weak AGNs in groups is supported by recent 
work by Lemaux et al. (2010), who performed near-IR spec- 
troscopy of galaxies dominated by old stellar population but 
have [on] emission in z = 0.8 and 0.9 clusters. They found that 
a significant fraction of them (~ 70%) harbor AGNs. It would 
not be surprising if a large fraction of the red [oil] emitters in 
our high redshift groups are AGNs as they have similar pho- 
tometric properties as those studied in Lemaux et al. (2010). 
However, other authors reported on increased dusty star for- 
mation activities in groups at high redshifts (e.g., Koyama et 
al. 2008; Koyama et al. 2010; Kocevski et al. 201 1). Tanaka et 
al. (2009) found that group galaxies at z ^ 1.2 show weak HS 
absorptions and they speculated that it might be due to large ex- 
tinction. Post-starburst galaxies might favor groups (Poggianti 
et al. 2009). Vergani et al. (2010) also reported that post- 
starburst galaxies prefer high density environments based on 
the zCOSMOS data. Recently, Hayashi et al. (2011) observed 
that both AGN and star formation take place in a z = 1.4 clus- 
ter 

Given this controversial situation, it is probably fair to say 
that the origin of the emission line is still unclear at this point. 
It may be that both dusty star formation activities and AGN ac- 
tivities increases at high redshifts and there is a strong cluster- 
cluster variation. Any conclusion on the origin of the [Oil] 
emission needs to be drawn from a larger statistical sample of 
groups at z ^ 1. An extensive near-IR spectroscopy targeting 
Ha and [Nil] lines of the red [Oil] emitters in groups to per- 
form emission line diagnostics such as the one proposed by 
Baldwin et al. (1981) would be an obvious way forward. Also, 
the newly developed AGN identification method by Tanaka et 
al. (2011) is effective as well because it requires only [Oil] 
and/or [Olll]. Deep Chandra observations are obviously help- 
ful as well. Using these techniques, we first have to discrimi- 
nate AGNs from star formation in order to interpret the recent 
observations that distant groups and clusters tend to show an 
increased rate of emission line galaxies. 

5. Summary 

We have presented photometric and spectroscopic analyses 
of zCOSMOS galaxies at 0.5 < z < 1. Unlike most of the previ- 
ous studies, we define the mass-selected environments to study 
the dependence of galaxy properties on environment. This is 
the most important feature of this work. Previous studies have 
shown that galaxy properties depend on mass of groups and 
clusters. These studies clearly show that environment needs to 
be defined by mass. 

We have found that the fraction of red galaxies is always 
higher in groups than in the field at 0.5 < z < 1 and it does 
not strongly change over this redshift range. This result might 
appear inconsistent with previous studies from zCOSMOS, but 
we have argued that this is due to different environment def- 
initions and to different definitions of red galaxies. The most 
important finding of this paper is that the fraction of [oil] emit- 



10 



X-ray Groups in zCOSMOS 



[Vol. 



ters on the red sequence increases in groups at higher redshifts, 
while the fraction does now show any significant evolution in 
the field. The increased red [Oil] emitters in groups must be 
due to increased dusty star formation activities and/or to in- 
creased AGN activities. We have studied these two possibili- 
ties by using the 30-band photometry and X-ray data. While 
the X-ray data do not put a strong constraint on them, the 
30-band photometry suggests that the stellar population of the 
[on] emitters in groups is old and there is no hint of enhanced 
dusty star forming activities. This lends support to increased 
AGN activities. 

Recent observations often report a high fraction of emission 
line galaxies in distant groups and clusters. The question now 
is where the emission comes from. We have obtained evidence 
for the AGN origin and recent near-IR spectroscopic work also 
favors it. But, our overall statistics is poor and some of the 
previous studies seem to favor the dusty star formation origin. 
More observations are obviously needed to settle the issue. 

This work is supported by World Premier International 
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also in part by KAKENHI No. 23740144. This work is 
based on observations undertaken at the European Southern 
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Large Program 175.A-0839. We would like to thank the anony- 
mous referee for useful comments, which helped improve the 
paper. 
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